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METHODOLOGY: A CRUCIAL ISSUE FOR RESEARCI! AND EVALUATION 

IN EXPERIMIHTAL PROGRAnS 

Introduc tion 

In the last ten years ^ creative ideas in edueation have been 
used poorly experimental programs which suffer froin lnadeQ_,uate 
administration 5 overemphasis on public relations, and Inappfo- 
priate research and evaluation* Many innovative Headstart pro-- 
. grams fell victim to a multiplicity of administrative styles which 
implemented the programs in such a manner as to make It impossible 
for them to fulfill their conceptual promise. Demonstration 
ichools featuring local control by disenfranchised minorities 
often were praised and publicised nationally before it had been 
determined whether or not they were accomplishing their goals, 
A tendency has existed to represent purely personal opinions and 
biases as if they were the incontrovert ibly eetablished findings 
of scientific research- Conseq_uentl?r s staff energies often were 
devoted to ''show and tell ' with little being done to eive the 
parents and studente the attention they required. A high mor- 
tality rate among innovative programs can be attributed to inappro- 
priate reiearch and evaluation techniques* It is no longer pos- 
sible for any program working with a predomlnantry black clientiBle 
to use the traditional aduGational research and evaluation tech- 
niques. Rejected is the practice of whltey coming in with a 
battery of pre-tests, disappearing for ten months^ and returnin/^ 
with a battery of post-teets. That rejection is evidant among 
the black grafiuate students , the black teacher^, the black admin- 
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iBtrator, the black high school student 3 and most forcibly ainong 
the black parents* But experimental programs must be rionitored 
and documented. 

This paper describes an attempt to deal with the issue of 
disaatisf action with the traditional approach to doing research 
and evaluation in a training and placement prograin for professional 
personnel in the inner-city schools of a large metropolitan area. 
It is not a report of findings* Instead, it is a discussion 
focusing onr 1) the klndj of questions that need to be examined 
in a program of this kind', 2) the rejection of traditional means 
for examining these questions.; and 3) the development of alter^* 
native ways for dealing with the problem. In order to promote 
clarity throughout the paper ^ a brief description of the con-= 
csptual and operational bases of the program is necessary, 

The _ ^ r o gr am 

The Ford Training and Placement Program seeks to train and 
place professional personnel in so-called inner-city' schoole-- 
that is 5 in schools which serve a lower socio-economic group 
evidencing educational disadvantage. Schools with these charac-^ 
teristics in northern urban centers generally have predominantly 
black student populations. In the initial conception of the Ford 
Training and Placement Program^ the school was seen as a social 
sygtem. The ef f ect IVQness of universities' current methods of 
preparing teachers ^ counselors ^ and administrators for positions 
in iiiner-city schools and the prevailing procedures for placing 
these personnel in inner-city schools were questianed. The practice 



of preparincr teachers alon^ gradis- line or a sub^ ect-inatt er dlmen-* 
sion did not attend to the reality of the school as a social systen 
composed of unique roles. The role of the inner-city teacher Is 
not the same as the role of the suhurban teacher^ yet universitiee 
prepared teachers ar f these roles were interchangeahle , Further, 
the concept of the school as a social system sugfrested that roles 
In the school never functioned in isolation ^ but in complementary 
relationships to the other roles. The work of the teacher iras 
related to that of the counselor, and to that of the administra^ 
tor^ and all were related to the community milieu. Yet the uni^- 
versities prepared teachers, counselors ^ and administrators in 
separate curricula though, once in a school, they functioned in 
these interconnected roles. 

Again^ the concept of the school as a social system iuggested 
that the greater the mutual understanding and good will among the 
various educational personnel, .the greater the effectiveness and 
efficiency of the school* Yet, once trained^ educational per^ 
eonnel were placed individually rather than as groups with no 
opportunity to get to know each other before the first day of 
echool- Finally, the conception of the sahool as a social system 
suggested that for the school to function properly there must be 
communication among the trainer (the university) , the user (the 
school) 5 and the client (the community) ,^ = 

A program for more efficient preparation and placenent of 
perionnel for inner^^clty schoole was projected. The program sought 
to reduce the isolation of beginning teachere in inner-city sehoolSs 
and to increaee communication among the school, the community, and 
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the unlvorsit^^. ^/he Departneiit of laucation and the Graduate 
School of Education of the University of Chicago obtained the 
cooperation of the Chicago Doard of Education and presented the 
plan to the Ford Foundation. The Ford Training and Placement 
Program^ envisioned as a slx^year program^ was begun in Janua:.y^ 1968- 

The Ford Training and Placement Prograri has banan the devel- 
opment of a demonstration training program for the inproved pre- 
paration of teachers and other professionals for urban schools* 
The prooram has the charge of demonstrating and disseminating what 
has been learned in Chicago to other teacher training institutions 
and school systems. The program alms at reducing the ls.jlation 
of teachers and other professional personnel in urban schools by 
increasing communication within the school and by providing group 
support for new teachers, adminlatrators ^ psychologists^ social 
workers 5 and special seryice personnel. The cadre device ^ras used 
to implement the need for focused and coordinated preparation and 
placement of new perDonnel in inner-'City schools. The notion of 
a cadre or team has been used to provide Interpersonal supports 
and functional communication between the experienced school staff 
and tbe new interns. Through the operation of the cadre ^ it was 
hoped that teachers and other professionals, both ne%^ and exper- 
ienced^ would benefit from an increased understanding of one an^- 
other's roles-, that problems central to the urban school would be 
Identified and dealt with more effectively by a group than by 
isolated individuals t and that this, in turn, would lead to improve-- 
ment in the quality of teaching and laarnlng in urban areag , In 
additioi^^ the involvement of teachers already in the school with 
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the training of new teachers in a university setting might have the 
salutary consequences that innovatlonE from rt-search customarily 
reported in the literature, mlRht be communicated and infused di- 
rectly in the ochools themselves. The cadre would provide a direct 
and open channel from the ■crainer = -the university-^to the practl== 
tioners.--the schoul staff. 

The Pora prceram is a conplcx one. Teachers and other per- 
sonnel are to be trained in six different traininf^ programs of the 
University: prosrcims deslRned to prepare teachers for secondary 
schools, teachers for olemontary schools, psycholoeloal specialists, 
adult educators, s=hool aoclal workers and school adirlnistrators . 
For each of these persons a three-year sequeme is invol-^ed: 
an initial training year, an internship year as a member of a cadre, 
and a year of bona fide employment in the Chicago public school 
in which he Interned. Three cadres including Sj parsons who were 
in training at the UulverBity have completed the second year of 
this sequence and have taken resular positions In the Chicago schools 
in September, 19f>9. Three other cadres includinfj 2h persons in 
training at the University are currently in their internship year 
in the Chicago schools. 

Beseareh and jSvaluatj-on ' ' - 

A basic foundation for intellicent decision-makina Ip a 
br.ckgroiind of information concerning t ,e issue about which the 
decision is to be made. Any program cf activity must be aocoinpanied 
by theoreileal, empirical and evaluative invastlgations . As prac- 
ticing educators , we havo ths responsibility to test solutions to 



operating problems; this is the function of ^valuation. As 
professional educators, ye have the responsibility to expand the 
field of knowledge about the educative process; this is the func- 
tion of research. Research ...nd evaluEtion, then, are both le^^i- 
tlrnate and necessary coriponents for inclusion in the Ford Training 
and Placeinent Program. However, the real issues are what question 
need to be examined ^ ^rhen to examine them, who shall examine them, 
and how they shall be examined. 
Research 

As in all experimental programs, there are many issues in 
the Ford Training and Placement Program' that would ba both inter^ 
esting and useful to researeli. Of course, the question is not 
what issues most conveniently lend themselves to research^ but 
rather it is a question of 1) establishing priarities for what - 
issues are to be researched and 2) selecting the appropriate time 
for examining a particular issue/ The identlf icati^on of Issues- 
to be researcl-td must follow closely the developmental phase of 
the project if the findings of research are to influence further 
development through revision. Research interest in this project 
is problem^^qriented . Research interests necessarily must yield 
to program demands. Issues must be examined with the full know- 
ledge that need for immediate revision in the program must take 
priority over the methodological needs of the research plan. First 
of all, the nature of the research in this setting is restricted 
by the fact that this is an experimental program which is in the 
process of developing. The situation must be kept flexible. The 
need for flexibility in the pogram restricts the ability of the 
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researcher to introduce the element of control necessary to 
research but incorapatible with the operation of the program. 
Second, we nre in the process of identifying variables in all 
plmses of the proBrara that should be taken into account es nodels 
for selectinG, training, and placing professional personnel that are 
developed- for more rigorous testinB at a later date. third, the 
situation at this Juncture further suggeits that information must 
first be gathered that permits a careful description of all phases 
of the project. Fourth, the research focus is on the function.- 
aries in the project. It would be little more than an exercise 
in futility to attempt research related to Influenca on pupil 
learning at this point. Although it is the pupil in the class- . 
room with whom we are ultimately eonoerned, it is imprudent to 
search randomly for impact on pupils. The precise nature of the 
*xpected change in pupil behavior has not been made clear. This 
will evolve soon, but we suspect. that it must come in the form of 
the 'effect of various teaching methods and the use of different 
teaching materials as well as the effect of individual teachers on 
learning outcom.es. The use of different methods and materials 
and more realistic training experiences are appropriate expec^- 
tations for Involvement in the Ford Training and Placement Program. 

A brief statemenf about some of the major aspects of the 
project that were to be examined ar^pears-to be in order before we 
proceed to discuss the resistancia to some of the traditional methods 
of gathering data. 
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The Ge nera l Research Plan 

Researcb efforts are discuGsed under two broad cateRorles 
with each major cp.tenory further broken down Into sub-categories. 
This division is made In order to introduce more clRrity in des- 
erlbinB the overall effort to gather information pertinent to the 
intent of the prograin. The two brond categorizations are: 
1) research within the university oetting and 2) research within 
■the cooperating school setting. 

Sesearch^;aMM.lMJMyim A historlcnl account 

of the project from its genesis through June of 1970 was to be 
attempted. First, a chronology of events in the history- of the 
project was' to be identified and recorded.. Second, a suminary of 
Important developments with the focus on an historical interpret- 
tation would follow. Events were to be examined and interpreted 
within the context of the societal framework in which this project 
is imbedded. This phase of the research effort is ndng fairly 
well as planned and will not be referred to again in this paper. 

A status study was to be undertaken which would provide 
baseline information about all students In the various training 
programs in the University which provided internB- for the Ford 
Training and Placement Program. Comparisons could be made with 
those students selecting the FTPP option. Additionally, this ■base-- 
line information would be valuable In looking at success or failure 
In inner-city teaching at a later date. Each student entering the 
program would also have available to him a profile of himself. 
Information was to be gathered on such variables as personality, 
rn?^- ^^^^^^ systems, attitudes, and also certain demographis information. 



These and other variables could comprise. the independent variables 
regressed on a dependent variable (succesfl in teachinf, in an inner- 
cit.v school). The strength of each independent variable to pre- 
dict teaching success could be deterinlned and variables that have 
little or no predictive value could be deleted. From a problem- 
oriented point of view,, a basis would be provided for solectinR 
trainees for the FTPP . From a theoretical point of view, an ex- 
plicit tnodei for the selection of inner-city teRchers could be 
developed. 

The training experiences that precede the internship year • 
offer . another rich source of research. A description of the 
training experiences nlons with the strengths that they are de- 
signed to devilop, followed by an assessment of their worth by 
the individual intern and his immediate supervisor in the cooper= 
ating school, should lead to valuable Information in developing 
a model for training. Those training inputs which are most val- 
uable to teachins in inner-city classrooms can be identified and 
incorporated into- the program of training, 

Research j7i thin, the cooperating school set ting. The cross- 
role cadi-e is the vehicle through which the trained personnel enter 
and work In the school. They are joined by professional personnel 
from the school in a six=week training session during the summer 
prior to entering the school in the fall. A non-participant ob- 
server was t,o be assigned to each cadre at the beginning of the 
summer training program and was to be with this cadre throughout 
the school year. A ease study could then be made of each group. 
The group was to be studied as a social system vith attention <?iven 
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to both the formal and informal atructures that evolve with its 
own particular rnode of operatior. V'« vers interested in such 
Issues as; 

1) Mode of operation of each cadre 

2) The cadre ns a worlt group 

3) Horras of behavior that arose 
k) Interaction within the cRdre 

5) Sentiments within the cadre 

6) Activities within the cadre 

7) The cadre as a supportive mechanism for nembers 

8) The cadre as a socializing influence 

9) Are all the roles within the cadre functional? 

10) Is there a sense of shared responslhillty within the cadre 

11) Is the isolation of new teachers reduced? 
Supposedly the presence of a cadre within a given school 

will have, some kind of an Impact on that school. Some questions 
which mlBht be asked are ■ 

1) Are barriers const,-ucted as a result of this Kind of 
entree into a school? 

2) What kinds of solutions to problems are facilitated 
primarily through the efforts of, cadre members? 

3) Is there a greater sense of shared responsibility among 
staff members at the end of the school year? 

h)- Do teachers within a oooperatinr =--hool look on educa- 
tional problems from a more comprehensive point of view at the 
end of the school year? 
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5) . What problems are presented by the presence of white 
cadre members irorkinR topether with blflck teachers and teachiriR 
black pupils in banieally all-black schools? 

6) Are n«}? c|;dre members abBorbed into the staff more 
efficiently; and eff#etively7 

A great deal of information r.bout each cooperatlnR school 
in order to lend more meaninsful interpretation of 
data gathered about each cc.dre. Information about the nature of 
the school will provide addlt ional Ins ight Into the strategy not 
only for making an affective entree into a school, but in deter- 
mining an effective mode ' of operation f or . the cadre once the proper 
entree is made. Variables that need to be considered In developing 
a modal for placlnB cadres in inner-city schools, can be Identified. 
Conditions in schools which are most conducive to the investioa- 
tlon of relationships among variables can be identified. Informa.. 
tion on variables such . as clinate , leader behavior , morale , and 
receptivity to change should be gathered. 

If teachers who are. trained toRether to teach in a certain 
location are better equipped to teach innar-c Ity youngsters , If 
they are subsequently placed tosether In a spacifie ichool, and 
if they have made the, choice to teach in inner-city schools, then 
there should be leas Job dlsBatlsfaetion anone these teachers and 
consequently less turnover. At the end of the school year (1970) 
a lonfiitudinal study will be begun related to the turnover of FTPP 
personnel in inner-city schoola as compared to turnover rates- 
amonB the regularly trained and placed personnel. This will be 
followed up each yeai". 



A;'Lu2' ^^r euwur ^jlari t;/ i n the prQ^ie^st ho.s been achieved, 
it will be in order to^ look directly at the teachin,^ hehavior 
of FTPP personnel to see hov^ new knowledsre and skills are actually 
bein^ used in the classroon. Ultimately, ve must be concerned 
directly in how this prograin is improving the learning of pupils* 
Only after it has been established clearly how the pupils should 
be affected by the new knowledge and skills which FTPP teachers 
brinp: to the inner-city classroom can we be^in to evaluate the 
impact of the experiment on pupils. If we expect a better quality 
performance on the sane task, we can make conparisons on pupil 
per f ormanee • If, hox^everj we expect Dupils to be able to perform 
different and more complex tasks ^ the expectations need to be 
spelled out. Appropriate kinds of achievement must be .identified 
before the concept of ciualitv can make a meaningful entry . 
Ey_aluatiqri . 

The function of evaluation In an:^ role that it may assume 
iri the Ford Training and Placement Prof^ram is to provide infor- 
m.ation that will facilitate decision-making. The ffoals of eval- 
uation in the program are to raise the important questionB which 
are pertinent to the issue and subsequently attempt to provide 
Information that will help answer then. Evaluation is not a sub- 
stitute for decision-making. It does , however , provide informa- 
tion that should be weighed when alternative courses of action 
are bein^ considered and thereby encouraffeB more Intellipent 

•deeision7maklng , 

2 ' 
Scriven talks about two approaehes to the evaluation of 

any plven entity. One approach to evaluation le the format ive 

or .procees approach , This type ^ of tvaluation ;ie an on-soing '. 



process throUfihoUt the life of the educational entity that is 
being evaluated^ thereby providinrs opportunity for ad,1 us tment • 
This feedback inf©rriation may corae in the form of inpresslonistic 
data based upon individual or collective observations* It may 
also come through testing outcomes at interini peri ods in the life 
of the entity* Formative evaluation facilitates revision at 
soiTie point other than at the end of a previously established 
.period* The other approach is through summative evaluation. This 

type of evaluation is interested in looking at outcones at the 

3 

end of a previouily determined period of time, V/estbury des-^- 
crlbee eummative evaluation as the considered appraisal of some 
vhole * In the FTPP summatlve evaluation is directly concerned 
with the deftree of attainment of programmatic goals. 

At this Juncture evaluation is of a process nature. A digest 
of attempts at evaluation for the 1969-70 academic year appears 
below: 

r) Summer training program 

2) Self-evaluation of cadres 

3) An attempt to establish motivating influences for . 
antering the program and problems encpuntered to date (interviews) 

k) Evaluation of special summ.er program.s ,for placement 

year cadres . 

5) Impresiions of plaeement year cadre members of FTPP 
1 

from their pr6i|ent perspective. 

As far as summatlve evaluation pjoes , are in the process of 
restating programmatic goals in behavioral terras so that they may 
be tested more conveniently* We are castino programmatic goals in 



an hierarciiical iramtiworKj pyiamidal , approach to setting up 
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objectives* This approach presupposes a broad base of rather 

specific kinds of objectives culminating in an apex of goals stated 

in rather broad terms* In this approach, one proceeds from gen-^ 

erally stated goals to objectives stated in varying degrees of 

ipecificity. Consequently^ when one thinks about evaiuating goal 

attainment, he^can examine those objectlvae vhich he has been able 

to state In behavioral terms* One proceeds in reverse manner to 

the way In which the objectives were set in that he begins with 

the measurement of behaviorally stated objectives. The general 

goal does not lend Itself to direct Investigation. Achievement 

of goals is discussed in terms of the degree to which the more 

specific objectives are met, 

Reilsta nce to Resear c h an d Ev aluation Efforts 
The attempt to do researc^h and evaluat Ion in the Ford Training 
and Placement Program has met with a great deal of resistance* A 
rather hard line against research and evaluation has been adopted' 
by a number of the participants In the program. This unwillingness 
to report has varied from refusal to cooperate in research and 
evaluation efforts in any way in one cadre to a coniiderable degree 
of participation in another with the third group being somewhere 
in betwaen the two extremes. 

The question of ^'Vfhat Is the nature of this rei ist ance? ^ 
needs to be examined* The need for research and evaluation has 
a '^commonplace obviousness^' ( to use Westbury * s term ) ^ about it • 
Scriven has pointed out that one can be againit evaluation only 
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if .one can show that it is improper to seek an answer to questions 
about the merit of educational instruments, which would involve 



ions 



shQwlng that there are no legitimate roles in which these quest 
can be raised, an extraordinary claim. The reasons for resist- 
ance, then, necessarily must be explained in other vaya . 

The traditional method of carrying on research and evalu- 
ation activities is no longer Viewed as adequate by a large segment 
of the professional community. The researcher comes in, intro- 
duces himself, gathers the data, promises feedback on the findings 
when the data are analyzed, and the subjects' never see him again. 
They may be able to read about themselves in some book o.r article 
and sometimes without understanding what is said. As a result, 
the gulf between research and practice. is made wider* The re- 
searcher writes for other researchers to read. Research, must be . 
made the business of other people in addition to the researcher * 

The matter of being able to trust the people / c arrying on 
the research effort is an important .variable to be considered. 
A question uppermost in the minds of the people who are being 
asked to reveal inf orniation is whether the researcher is really 
looking for an answer to the question he has posed. Respondents 
often fear this information may be misused. The researcher fre- 
quently is viewed as uncommitted to adding information of any real 
value to the pra^ctit ioner , The motives of the researcher are often 
suspect and in many eases theae suspicions are bona fide. All 
people in the research community have become stereotypad as a 
result, of the '-hit and run^^ tactics of many restarcheri . 
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People may exhibit an unwillingness to report because they 
feel that they are being viewed as objects. Often a deep resent^» 
ment develops against research efforts if people feel they are ' 
being used in some manner or another* They resent 'the idea of 
being manipulated by others* 

They also may feel that they have no stake in the research 
effort. The research may be viewed as Irrelevant for them: the 
findings may be thought to make little or no difference to them as 
praatitioneri . They may feel that the decision'-makers will not be 
Influenced by the findings * The stake they have in the rtsearch 
or evaluation being done may be obscure and no reason is made 
apparent to them as to why they should participate. Cons equent ly , 
any time that is spent on refjearch and evaluat i on enjoys a rather 
low position in their order of priority. 

The white researcher of ten is viewed as suspect in the black 
community. His understanding of the pi^oblems of the black person 
may be perceived as inadequate* The very fact that he is there 
is viewed ^with alarm and many times with good reason. Too many 
white researchers have "'used'' the black community as a source of 
information for their own purposes. It takes a considerable length 
of time to convince the more powerful and Influential people of 
the black . Gommunlty that the white researcher*s motives are 
proper and acceptable* 

Another problem is the high degree of anxiety that eyalu« 
ation usually provokes , AlthQugh each day is filled with one 
Judgment after another being made , many people will resist any 
attempt at systematic evaluat ion , even when they are doing the . — 
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evaluating themselves. As a profession, education has succesS'- 
fully resisted evaluation. As a result^ we have disguised our 
successes as well as our failures. If ve are to survive and grow 
as a profession^ we can no longer afford to be immune to research 
and evaluation. There is growing presure from inside the pro-- 
fesiion to he ahle to articulate our successes and failures to 
others. Much of this internal pressure ^ unfortunately , has re- 
sulted from pressure outside the profeision. It has descended ' 
upon us from many sources but is nonetheless real/ Some has come 
from funding agencies vhich are demanding^ some degree of account- 
ability, a legitimate demand. Some of it has come from business 
concerne which are now turning their technological know-how 
loose on the schools. Other pressures have come from individuals 
anxious to make a name for themselves and find the schools an 
easy and Interesting target, A grea'^ deal more is coming from " 
the countless number of Interested people in the communlt 1 es 
across the nation who are demanding more accountability from 
our schools than In past years but , at the same time, are willing 
to let the schooli provide the means. 

Reluctance to participate In research and evaluation in the 
Ford Training and Placement Program also has varied with the method 
of data collection being empaoyed. The participants in the program 
have resisted almost totally the more classical methods of the 
field of educational psychology and the quan;titative orientation ' 
of contemporary socloldgyt For the time being, we have :been 
forced to abandon the structured, 'disguleed Instrument s used : in 
^ educational psychology and contemporary sociology . The use of the 
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daily or weekly log has met with only a minimuin of success. The 
straightforward questionnaire with rnore openended questions and 
also the Interview are apparently not as distasteful to most of 
the participants in the program. The observational jnethod of 
collecting data was resisted in the beginning, hut l-j now serving 
as the main source of Information in two of the cadres. The rest 
of this paper is a discussion of the observational method in 
data gathering, . 

ft 

An Alternative 

Although the original research and evaluation plan proposed 
that considerable use be made of the observation technique of data 
collection, it has since hacome the major technique now being employed 
In the PTPP. One cadre permitted a research person to be present 
after the first month of school. Another researcher began meetine 
with another cadre in December of 1969 . This^ is supplemented by 
information gfithered through questionnaires and interviews. It 
is- now possible to follow the further development of these groups 
as social syitems through a period of time. The focal concern 
of this section is to exainlne a few of the major assets and lim- 
itations of the structured observation technique. 

Much Of the data with which social science deals may be 
Obtained by direct observation. Direct observation may allow the 
researcher to study behavior with a minimum of alternation in the 
social situation. The greatest advantage of the technique is 
probably in the recording of behavior , as it is enacted. To quote 
from Selltlz : , ■ ' 
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All too many research techniques depend entirely on 
people's retrospective or anticipatory reports of their 
behavior . , , In contrast ohservat ional techniques yield 
data that pertain directly to typical behavioral situations . 

ObserViitlon permits the gathering of data even if the sub^ 
Jeets are unwilling to report."^ Less cooperation Is required of 
the subject than with most other techniques , People may not have 
the time or may no^t be so inclined to be int ervl ewed or to fill 
out a questionnaire, but will not object to th^ presence of an 
observer. Although all resistance to research cannot be overcome 
In this manner^ It Is less demanding of active cooperation , 

Obiervatlon is flexible and readily acceptable. In the FTPP 
observations are being made in natural surroundings. This method^ 
ology can be adapted easily to the laboratory. It may be used to 
develop hypotheses , test hypotheses , or for descriptive purposes 
only. We are attempting to both describe and explore in the PTPP . 
Hopefully ^e will gain insights which can later be explored by 
Other techniques. 

Another advantage of observation is its capacity to be 
utilised to assess behavior through time, Whyte Illustrates this 
aspeet of observation * 

I now came to realise that time itself was one of the key 
elements in my study, I was observing, desGrlblng, and 
analyzing groups as they evolved and changed through time. 
It seemed to me that I could explain much more effectively 
the. behavior of men when I observed them over time than 
would have been the case if I had got them at one point in 
time. In other words , I was taking a moving picture instead 
of a still photograph ,11 ^ 

12 

Becker points out that observation is of more value in under- 
itanding a particular organisation than demonstrating relati^ 
ships between abstractly defined variables. It Is obs trvation that 



allows the field study to obtain information on interrelatione 
in group structure and social interaction as on-going prQcesses, 
It permits an in=depth study of the group. 

The observation technique also has serious limitations. 
It is not always possible to predict the occurrence of an event 
and the observer may not be present to observe it. He are hopeful 
that this void may be filled by our use of tb€ interviav or ques^ 
tionnaire. Furthermore , all events do not lend tliemselves to 
observation. It is certainly not the most eoonomioal procedure 
for gathering or analyzing data . 

Thare are procedural Issues in observation studies which are 
crucial but thle is no less true of any procedure or method being 
utiliiied. There are four general questions which must be answered 
by an inve st igator . 

(l) What should be observed? (2) How should observations 
be recorded? (3) What procedures should be used to try to 
assure the accuracy : of observation? (k) What relationship 
should txist between the observer and the observed, and how 
can such a relationship be est ablished?13 

All of the above issues vary for each study and must be answered 
for that particular setting* It cannot be the function of this 
paper to describe the procedures employed iri the Ford Training 
and Placement Program* 

A Final Word 

The present plan for conducting research and evaluation in ' 
the Ford Training and Placement Program can be conceptuall 7.ed along 
the following lines* The plan embraces both scope and sequance and 
is divided into four phases / Although events in the four phases 
:^a'3^,^.«.::^^curri are, conceptually independent . ^ 



Phase one is a knowledge-^seeking period, VJe have employed 
primarily perception data in our analyses to date but are in the 
process of gathering natural data through observation. We are 
attempting to answer some bf the^uestions alluded to earlier in 
this paper. Hopefully thi s will include also the self ^evaluation 
of each cadre. This knowledge is providing a base for developing 
models for selection of participants, tr^aining and placement which 
will be tested more rigorously in the future* 

Phase two involves a restructuring of training^ experiences 
by revising the focused preparation and coordinated preparation 
of participants referred to in Getzels* original paper. The 
program of training for the summer of 1970 should reflect eome 
phange as a result of the findings of research and evaluation. 

Phase three places emphasis on the restatement of goals in ^ 
terms of programmatic objectives* They are being cast in behavioral 
terms and will lend themselves to testing in the future* They are 
also undergoing needed revision. Specific statements regarding 
pupil growth should be forthcoming in the future * 

Phase four represents the period in which more rigorous testing 
and evaluation can occur. The proper framewnrk for this phase must 
first be built if truly meaningful and valuable findings are to emerge 

.Resistance to research and evaluation is to be anticipated 
as a fact of life for those currently engaged in educational re» 
eearch* We recosniae that this plan will not eliminate all resist- 
ance to research and evaluation in the FTPP. However, It is hoped 
that this plan for conducting research and evalua will allow 

the reeistance to be reduced to a level whlGh will permit neceiiary 
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data collection. If the innovative ideas of the Ford Training 
and Placement Program are to avoid the fate of' many other good 
ideas in education, careful attention must be given to the planning 
and implementation of a scientifically sound but functional re- 
search and evaluation plan. 
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